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On a continuous time game with incomplete information 
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Abstract 

For zero-sum two-player continuous-time games witii integral payoff and incomplete 
information on one side, one shows that the optimal strategy of the informed player can 
be computed through an auxiliary optimization problem over some martingale measures. 
One also characterizes the optimal martingale measures and compute it explicitely in 
several examples. 
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In this paper we investigate a two-player zero-sum continuous time game in which the 
, players have an asymmetric information on the running payoff. The description of the game 

^ . involves 

X 



^ ■ (i) an initial time to > and a terminal time T > to, 



(ii) / integral payoffs (where / > 2): ii : [0,T] x U x y ^ IR for i = 1, . . . I where U and 
V are compact subsets of some finite dimensional spaces, 

(iii) a probability p = (pj)i=i,...,/ belonging to the set A(/) of probabilities on {1, ... , /}. 

The game is played in two steps: at time to, the index i is chosen at random among {1, . . . , /} 
according to the probability p ; the choice of i is communicated to Player 1 only. 
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Then the players choose their respective controls in order, for Player 1, to minimize the 
integral payoff J^^ £i{s,u{s),v{s))ds, and for Player 2 to maximize it. We assume that both 
players observe their opponent's control. Note however that Player 2 does not know which 
payoff he/she is actually maximizing. 

Our game is a continuous time version of the famous repeated game with lack of infor- 
mation on one side studied by Aumann and Maschler (see [U [T3] ) . The existence of a value 
for our game has been investigated in [5] (in a more general framework): if Isaacs' condition 
holds: 



H{t,p) = inf sup > pi£i{t,u,v) = sup inf > piii{t,u,v) 

1 = 1 2 = 1 



V(t,p) e [0,T] X A(/) , 

(0.1) 



then the game has a value V = V(to,p) given by 

I 

V{to,p) = inf sup y^piEa^p 



r rT 



£i{s,ai{s),(3{s))ds 



to 



(0.2) 



sup inf y^piBa^/s / 

/3eB,.(io) (a»)e(-4r(to))^ ^ Uto 



ii{s,ai{s),f3{s))ds 



for any {to,p) £ [0, T] x A(/), where the G Ar{to) (for i = 1, . . . , /) are / random strategies 
for Player 1, /? G B^to) is a random strategy for Player 2 and E.,, (/,^ £.(., «.(.), /3(.))d.) 
is the payoff associated with the pair of strategies (a^, /?): these notions are explained in the 
next section. In [5] we also show that the value function V can be characterized in terms 
of dual solutions of some Hamilton- Jacobi equations, which, following [3], is equivalent to 
saying that V is the unique viscosity solution of the following HJ equation: 



min <wt + H{t,p) ; 



w 



Qp2 



in [0,r] X A(I) . 



(0.3) 



In the above equation, Amin (^) denotes the minimal eigenvalue of A, for any symmetric 
matrix A. Note in particular that this equation says that V is convex with respect to p. 



This paper is mainly devoted to the construction and the analysis of the optimal strategy 
for the informed player (Player 1). In particular we want to understand how he/she has to 
quantify the amount information he/she reveals at each time. Our key step towards this 
aim is the following equality: 

l-T 



min Ep 

PeM(to,po) 



H{s, p{s))ds 



to 



V(io,J5o) G [o,r] X A(/) 



(0.4) 
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where M(to,J'o) is the set of martingale measures P on the set D(to) of cadlag processes p 
hving in A(I) and such that p(tg ) = po and p(T) belong to the extremal points of A(/). 
Equality (j0.4p is reminiscent of a result of [7J in the discrete-time framework. It is directly 
related with the construction of the optimal strategy for the informed player. Indeed, let 
P be an optimal martingale measure in (j0.4p . p(i) = {pi{t), . . . ,pi{t)) the coordonnate 
mapping on D(to) and {ei, . . . , e/} the canonical basis of IR'^. Then the informed player, 
knowing that the index i has been chosen by nature, has just to play the random control 
t — > argmin^ pj(t)^j(t, n, f ) with probability Pj, where Pj is the restriction of the law 
P to the event {p(T) = Cj}. 

We give two proofs of (j0.4p . The first one relies on a time discretization of the value func- 
tion taken from [H] and the explicit construction of an approximated martingale measure 
in the discrete game. The second one is based on a dynamic programming for the right- 
hand side of (j0.4p and on the relation between this dynamic programming and the notion of 
viscosity solution of (j0.3p . We shall see in particular that the obstacle term Amin ^ 

is directly related with the minimization over the martingale measures P. 

Since the optimal martingale in (j0.4p plays a central role in our game, an analysis of 
this martingale is now in order. This is the aim of section 3. We show that, under such 
a martingale measure P, the canonical process p{t) has to live in the set TCit) C A(I) in 
which, heuristically, the Hamilton-Jacobi equation 

holds. Moreover the process p(i) can only jump on the faces of the graph of V(i, •). Namely, 
for any t £ [to,T], there is a measurable selection ^ of 9V(t, p(t~)), such that 

Y{t, p{t)) - V(t, p{t-)) - p{t) - Pit-)) = P - a.s. 

Conversely, under suitable regularity assumptions on V and on 7i, a martingale measure 
satisfying these two conditions turns out to be optimal in (j0.4p . 

In section 4 we compute the optimal martingale measures for several examples of games. 
These examples show that, under the optimal measure, the process p can have very different 
behavior. When 1 = 2 and under suitable regularity conditions, the optimal measure is 
purely discontinuous. For instance we describe a game in which this optimal measure is 
unique and has to be the law of an Azema martingale. In higher dimension, uniqueness is 
lost in general. Moreover we give a class of examples in which, although there are optimal 
measures which are purely discontinuous, they are also optimal measures under which p is 
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a continuous process. For instance we show a game in which p hves on an expending convex 
body moving with (reversed time) mean curvature motion. In this case case the law of p 
takes the form 

dpt = {I - at<^ at)dBt , 

where (Bt) is a Brownian motion and the process at hves in the unit sphere. 
We complete the paper in section 5 by a list of open questions. 



1 Notations and general results 

In this part we introduce the main notations and assumptions needed in the paper. We also 
recall the main results of O U] : existence of a value for the game with lack of information 
on one side, as well as the characterization of the value. 

Notations : Throughout the paper, x.y and {x,y) denote the scalar product in the 
space of vectors x,y E IR^ (for some K > 1), and | • | the euclidean norm. The closed ball of 
center x and radius r is denoted by Br{x). The set A (I) is the set of probabilities measures 
on {1, . . . , /}, always identified with the simplex of R^: 

I 

= (Pi) • • • )P/) £ A(I) Pi = I and Pi > foi i = 1, . . . I . 

i=l 

If p G A(/), we denote by T/s^^^{p) the tangent cone to A(/) at p: 



TA(i){p)=[j (A(/)-p)/A. 

A>0 

We denote by {ej, i = 1, . . . ,1} the canonical basis oflR^. For any map cp : A(I) ^ IR, 
Vex</> is the convex hull of (f). We also denote by Sj the set of symetric matrices of size I x I. 

Throughout the paper we assume the following conditions on the data: 

{i) U and V are compact subsets of some finite dimensional spaces, 
a) For i = 1, . . . , I, the payoff functions £{ : U x V ^ JR are continuous. 

We also always assume that Isaac's condition holds and define the Hamiltonian of the game 
as: 

I I 
H{t,p) := rain max y pj£j(t, u, w) = maxmin > pi£i{t,u,v) (1-6) 



u&U v&V ^-^ v^V uGU ■ 

i=l 1=1 
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for any {t,p) G [0,r] x A(/). 



For any to < T, the set of open-loop controls for Player I is defined by 

U{to) = {u : [to,T] — > U Lebesgue measurable} . 

Open-loop controls for Player II are defined symmetrically and denoted V(to)- 

A pure strategy for Player I at time to is a map a : V{to) ^ U{to) which is nonanticipative 
with delay, i.e., there is a partition < to < ti < ■ ■ ■ < tk = T such that, for any 
vi,V2 G V{to), if vi = V2 a.e. on [to,ti] for some i E {0, . . . ,k — 1}, then a{vi) = a{v2) a.e. 
on [to,ti+i]. 

Let us fix a set of probability spaces which is non trivial and stable by product. A 
random control for Player I at time to is a pair ((0„, J^u, ^u), u) where the probability space 
(0tt,jF„,P„) belongs to £ and where « : 0„ l^{to) is Borel measurable from {0u,^u) to 
U{to) endowed with the L^— distance. We denote by Ur{to) the set of random controls for 
Player I at time to £^nd abbreviate the notation ((0„, P„), into simply u. 

In the same way, a random strategy for Player I is a pair ((0q,, P^), a), where 
{0a,^a,Pa) is & probability space in £ and a : 0^ x V{to) —>■ U{to) satisfies 

(i) a is measurable from 0a x V(to) to U{to), with 0^ endowed with the cr— field and 
U{to) and V{to) with the Borel cr— field associated with the L^— distance, 

(ii) there is a partition to < ti < ■ ■ ■ < t^ = T such that, for any vi,V2 € V{to), if vi = V2 
a.e. on [to, ti] for some i G {0, . . . , fc — 1}, then a{(jj, vi) = a(LJ, V2) a.e. on [to, tj+i] for 
any uj £ 0a- 

We denote by .A(to) the set of pure strategies and by v4r(to) the set of random strategies 
for Player I. By abuse of notations, an element of ^^(to) is simply noted a, instead of 
((0Q,, .T^a, Pq,), a), the underlying probability space being always denoted by {0aj J'aj^a)- 
Note that Ur{to) C A(to)- 

In order to take into account the fact that Player I knows the index i of the terminal 
payoff, an admissible strategy for Player I is actually a I— uple d = (ai, . . . , aj) € {Ar{to)y ■ 

Pure and random controls and strategies for Player II are defined symmetrically; Vr(to) 
denotes the set of random controls for Player II, while ^(to) (resp. Br{to)) denotes the set 
of pure strategies (resp. random strategies). Generic elements of Br (to) are denoted by P, 
with associated probability space (0^,.F^,P^). 

Let us recall the 
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Lemma 1.1 (Lemma 2.2 of [3]) For any pair [a, (5) £ ^^(^0) ^ 'Br(io) (^''T'd any uj := 
{uji,uj2) G 0« X 0/3; there is a unique pair {u^,Vuj) G l^(to) x V{to), such that 

aiu;i,Vuj) = and P{uj2,u^) = . (1.7) 

Furthermore the map to — > {u^,v^) is measurable from 0a '>^®f3 endowed with Ta ® into 
Uito) X V(to) endowed with the Borel a— field associated with the L^ — distance. 

Notations : Given any pair (a, (3) G .Ar(to) X'Br(to)) the expectation Eq,^ is the integral 
over 0a X 0^ against the probabihty measure Pq,<8'P/3- In particular, : [0, T] x ?7x V ^ IR 
is some bounded continuous map and t G {tQ,T\, we have 



0/3 



T 



0(s, a, I3)ds 



(^j^ (/.(s,u^(s),t;^(s)ds^ dP„®P^(w) , (1.8) 



where {u^,v^^) is defined by (|1.7p . If one of the strategies is deterministic, we simply drop 
its subscript in the expectation. 

As a particular case of Theorem 4.2 of [5] we have: 

Theorem 1.2 (Existence of the value [5j) Assume that conditions ( fi.Jj) and M.Ojl are 

satisfied. Then equality h0.2(l holds and we denote by \'(tQ,p) the common value. 

In order to give the characterization of V, we have to recall that the Fenchel conjugate 
w* of a map w : [0, T] x A(/) ^ IR is defined by 

w*{t,p) = max p.p — w{t,p) V(t,p) G [0, T] x IR^ . 
peA(7) 

In particular V* denotes the conjugate of V. If now w is defined on the dual space [0, T] xIR^, 
we also denote by w* its conjugate with respect to p given by 

w*{t,p) = maxp.p — w{t,p) y{t,p) G [0, T] x A(/) . 

Proposition 1.3 (Characterization of the value, [5]) Under the assumptions of The- 
orem UTB. the value function V is the unique function defined on [0,T] x A(/) such that 

(i) V is Lipschitz continuous in all its variables, convex with respect to p and vanishes at 
t = T, 

(a) for any p G A(/), t Y{t,p) is a viscosity subsolution of the Hamilton- J acohi equa- 
tion 

wt + H{t,p) = in {0,T) (1.9) 

where H is defined by U.b]) . 
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(in) For any smooth test function (j) = (p^p) and any p G IR^ such that t V*(t,p) 

ov* 

dp 



has a local maximum at some t and such that the derivative p := ^^^{t,p) exists, one 



has: 

Mt,p)-H{t,p)>0. (1.10) 
We say that V is the unique dual solution of the HJ equation U.9\) with terminal condition 

v(r,p) = 0. 

Remark 1.4 In particular V does not depend on the class of probability space £ chosen 
to define the random strategies. In view of the construction of the next chapter, we note 
that, given a family of probability measures, one can always built a set £ containing this 
family and such that £ is stable by product. 

In [3] we prove that the following characterization of V also holds: 

Proposition 1.5 (Equivalent characterization [3]) V is the unique Lipschitz continu- 
ous viscosity solution of the following obstacle problem 

mm !^wt + H{t,p) ; X^i^(^^^^ = in (0, T) x A(/) (1.11) 

which satisfies V{T,p) = in A(/). 

In the above proposition, we say that w is a subsolution of the terminal time Hamilton- 
Jacobi equation (jl.lip if, for any smooth test function (p : (0,T) x A(/) IR such that 
w — (j) has a local maximum at some point (t,p) G (0, T) x Int{A{I)), one has 

max |(/)t(t,p) + H{t,p) ; Amin (^P, ^(^'P)) } ~ ^ 



where, for any {p, A) £ A(/) x Sj, 

\mm{p,A.)= mm {Az,z)/\z\'^ . 

z&T^(i){p)\{oy 

We say that w is a supersolution of (jl.lip if, for any test function (f) : (0,T) x A(/) IR 
such that w — (j) has a local minimum at some point (t,p) G (0, T) x A(/), one has 

max I <pt{t, p) + H{t,p); X^in(p,^-t(t,p)]\ < 0. 



Finally a solution of (II. lip is a sub- and a super-solution of (jl.lip . 
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2 Representation of the solution 



Let us denote by D(fo) the set of cadlag functions from ]R which are constant on 

(—00, to) and on [T, +00), by t 1-^ p(t) the coordinate mapping on D(to) and by ^ = (Gt) 
the filtration generated by 1 1-^ p(t). 

Given pQ £ A(/), we denote by M(to,Po) the set of probabihty measures P on D(to) 
such that, under P, (p(t),t € [0, T]) is a martingale and satisfies : 



for t < to, p{t) = po and, for t >T, p{t) G {ej 



!,...,/} 



-a.s. . 



Finally for any measure P on D(to), we denote by Ep[. . . ] the expectation with respect to 
P. 

Our main result is the following equality: 
Theorem 2.1 



V(to,Po) = inf Ep 
PeM(to,po) 



H{s, p{s))ds 



to 



V(to,Po) G [0,T] X A(/) . (2.12) 



We shall give two proofs of the result. The first one is based on a discretization procedure 
for V, while the second one uses a more direct approach of dynamic programming. Before 
this we show how to use the above theorem to get optimal strategies for the first player. 



2.1 Construction of an optimal strategy 

We explain here how to use Theorem 12.11 to built an optimal strategy for the informed 
Player. The construction of an optimal strategy for the non-informed Player, which uses 
completely diff'erent arguments (the so-called approchability procedure) is described in [15] . 

Lemma 2.2 For any {to,po) there is at least one optimal martingale measure for problem 



Proof : Let be a sequence of measures (Pn)ne]N C M(to,Po) satisfying 



lim Ep„ 



H{s,p{s))ds 



to 



(2.13) 



Since, under all P S M(to,Po)) the coordinate process p is a martingale with support in 
the same compact space A(/), (Pn) converges weakly (up to some subsequence) to some 
measure P that still belongs to M(to,Po) (see Meyer-Zheng [H]). Since H is bounded and 
continuous, passing to the limit in (|2.13p gives 



H{s, p{s))ds 



to 
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Hence P is optimal. 



Let (to)Po) £ [0;^) ^ ^(-^) be fixed, P be optimal in the problem ()2.12p . Let us set 
Ei = {p(T) = a} and define the probability measure Pj by: WA £ G, Pi(^) := Pi^l-Ej] = 
p{AnEt) ^ .£ ^ Pj(^) = PiA) for an arbitrary probability measure P £ M(to,Po) if 

Pi = 0. 
We also set 

u(t) = u*(t,p(t)) VtGlR 
and denote by Uj the random control Uj = ((D(to), ^, Pj)i ^) S Urito). 

Theorem 2.3 The strategy consisting in playing the random control (ui)i=i,...,/ G (L(r{to))^ 
is optimal for \ [to, po). Namely 



V(to,Po) = sup V^piEfl, / ii{s,u. 
/3eBr(io) j=i LJto 



(s),/3(ui)(s))ds 



Proof : Since 



sup V]piEfl^,/3 / ii{s,Ui{s),P{ui){s))ds 



it is enough to prove the equality 



sup 



o) j=i L-'io 



V(to,Po) = sup V^piEu^ / £j(s,Ui(s),/5(ui)(s))(is 
/3GB(to) i=i L^io 

Let us note that, since p(T) G {ei, . . . , e/} P a.s., we have 

J]ls,e, = p(r) P 



(2.14) 



a.s. 



(2.15) 



i=l 



Let us fix a strategy /3 G -B(to) and set v = /3(u). Then 

^PiEu^ / £i(s,Ui(s),/3(ui)(s))ds =^Ep / ii{s,vi{s),w{s))ds \ E, 

i=i i-Jto -I j=i yjto 



Ei 



Ef 



^1e, I ^^{s,u{s),w{s))ds 
i=l -^^0 



(p(r), / eis,uis)Ms))ds) 

to 
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(from (|2J5]) and where i={ii,...4i) 



(p(s),^(s,u(s), v(s)))(is 



to 



(by Ito's formula, since p(s) is a martingale under P and the process u(s), v(s)) is {Qs 
adapted) 



< Ef 



max(p(s), £(s, u*{s, p{s)),v))ds 



to 



Ef 



H{s, Tp{s))ds 



to 



So we have proved that (|2.14p holds. 



2.2 Proof of Theorem 12.11 by discretization 

For simplicity of notations we shall prove Theorem 12.11 for to = 0, the proof in the general 
case being similar. 

Let us start with an approximation of the value function. This approximation is a 
particular case of [ T3] . Let n G IN*, r = 1/n be the time-step and let us set tk = kT/n for 
= 0, . . . , n. We define by backward induction 

V^(r,p) = VpGA(/) 

and, if V^(tfc+i, •) is defined, then 

V-(tfc,p) = Vex (V-(tfc+i, •) + TH{tk, ■)) (p) 

where \eyi{(j)){p) stands for the convex hull of the map (j) = (pip) with respect to p. 

Lemma 2.4 (|T4j) V"^ uniformly converges to \' as t ^ in the following sense: 

hm V-(tfc,p') = V{t,p) y{t,p) G [0,T] X A(/) . 

For any k = 0,... ,n and p G A(/) there are A'' = (Af ) G A(/) and vr'' = (vr'"'') G A(I) 
such that 

(i) ^ Afvr^'' =p and (ii) V^tk,p) = Af (v^tk+uTr'^^') + TH{tk,7r'^'')) 
1=1 1=1 

(2.16) 

Without loss of generality we can choose the maps p i-^ ^^{p) and p ^ t^^{p) Borel mea- 
surable. For any i G {1, . . . , /} we now define a process (p|., k G {0, . . . , n + 1}) on some 
arbitrary, big enough probability space {VL,J-,P) with values in A (I): 
we start with Pq = po and, if p^ is defined for A; < n — 1, 
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• if the i-th coordinate of p\ satisfies (p^)j > 0, then the variable p^_|_i takes its values 
in {vr'^'' {pi), / G {!,...,/}} with 

I}, p[pUi = ^'^^ (Pl) IP^o, . . . , Pi„ J = 1, . . . , /] = ^'(Pp^--'(P'^\ 

• if = 0, then we set p'^^-^ = p'^. 
For A: = n + 1, we simply set p^+i = Cj . 

Finally we set p^ = p^ where i is the index chosen at random by natme (i.e. i is a random 
variable that is independent from the processes {pl.),i £ {1,...,/} and takes the values 
with probability pi, . . . ,pj respectively). The following Lemma is classical in the 
framework of repeated game theory with lack of information on one side (see I13j). 

Lemma 2.5 If we denote by {J-'k, k = 0, . . . ,n + 1) the filtration generated by (pk), then 

P[i = i\J^k] = {Pk)i VfcG {0,...,n+l}, Vi G {!,...,/} . 

In particular, the process (p^, k = 0, . . . ,n + 1) is a martingale. 

Proof : The result is obvious for k = n + 1. Let us prove by induction on k that, for all 

ie {!,..., I}, 

P[i = i\J^k] = {Pk)i , (2.17) 

for k = 0, . . . , n. For k = 0, equality (j2.17|) is obvious. We now assume that (j2.17p holds 
true up to some k and check that P[i = i \ J^k+i] = (Pfc+i)j- Since the variables pk take 
their values in a finite set, we can explicitely write 

P[i = i\ J^k+i]=Y.P[i = i\A]lA, (2.18) 

AeA 

where the set A is also finite and contains only sets of the form A = {pi = ai, . . . ,pk = 
Oik-i Pfc+i = ^^''(Pfe)} with ai, . . . , afc G A(/) and / G {1, . . . , /} with P[A > 0]. For such a 
A ^ A, let us write 

P[i = i\A\ = P[{i = ^]r^ A]/{Y^ P[{\ = j] n A]) . (2.19) 

and, for j such that (afc)j > 0, using the independence between i and the processes (p;[), 

P[{i = j] n yl] = P[i = j, p{ = ai, . . . , pi^ = afc, pi^, = ^^''(pi)] 

= ^[i = j]P[vi+i = 7r^''(pi)|pi = ai, . . . , pi = ak]P[v{ = ai, • • • , p^ = Ofc] 

= P[l= J,p{=ai,...,pi=ak\ . 

(2.20) 
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Now, by the induction assumption, 



P[i = j, Pi = ai,... ,pI = Uk] = P[i = j,pi = ai,...,pk = ak] 

= {ak)jP[pi = ai,. . . ,pk = Ok] ■ 



Thus, putting together (|2J9]) . ([2:20]) and ([2:2T]) . we find out that 

P[i = i|A]=vrf-'(a,). 
But, on A, Uk = Pk, therefore, comming back to ()2.18p . we get 
P[i = i\ J='k+i] = T.AeA ^f''(Pfe)lA 

= (Pfc+l)i- 



(2.21) 



Lemma 2.6 



n-l 



r=0 



Proof : Let us show by (backward) induction on k that 



E 



n-l 



r^H{tr,p 



r+1) 



r=0 



E 



k-l 



V^{tk,Pk)+T^H{tr,p 



r+1) 



r=0 



Note that setting k = gives the Lemma. 

For k = n, the result is obvious since V'^(r, p) = 0. Let us assume that the result holds 
true for k + 1 and show that it still holds true for k. By the induction assumption we have 



E 



n-l 



ri P 



'r+1) 



r=0 



E 



V^itk+uPk+i) + T^H{t ri P 



'r+D 



r=0 



We note that, for all suitable function /, 



E[/(pfc+l)|cr{i,Pfe}] = J2tHi=i}J2, 



/(vt'^'HpI)) 

E^Hi=^}El ''^";g:'^"^V (vr^''(P.)) 



Thus, by Lemma 



E[/(p.+i)k{p J] = 5^(p,), ^^^p^Mip^/ 
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In particular, by the definition of A'^ and tt^ in (|2.16p . we deduce that 
B[V {tk+i,Pk+i) + TH{tk,Pk+i)\Pk] = V^(tfc,pfc). 

So 

" n-l "I r k-1 



E 



' n-l 

which completes the proof. 



r=0 



We are now ready to show the inequality 



V(0, po) > inf Ep ( r H{s, p{s))ds 
PeM{o,po) V^o 



(2.22) 



Let W{0,po) denote the right-hand side of this inequality. Let us fix e > and let r 
1/n > sufficiently small so that 

|V(0,po)-V^(0,po)| <e 
\H{t,p) - H{s,p)\ <e V|s - t| < r, Vp G A(/) . 



and 



Let (pfc) be the martingale defined above. We built with this discrete time martingale a 
continuous one by setting: p(i) = pQ iit < 0, p{t) = Pk+i if i G [tk, ifc+i) for /c = 0, . . . , n — 1 
and p(t) = Pn+i if t > r. The law of (p(t)) defines a martingale measure P G M(0,po)- 
Then 

V(0,po) > V-(0,po)-e 



> E 

> E 

> Ep 



'^Er=0 H{tr,Pr+l) 

Jo H{s,p{s))ds 
Jo H{s,p{s))ds 



2e 



2e 



> W{0,po)-2e 



This proves (12:22]) . 
Next we show 



V(0,po)< inf r H{s,p{s))ds) 

PeM{o,po) / 



(2.23) 



For this let us fix a martingale measure P G M(0,po)- For n G IN* large, we discretize the 
canonical process p in the usual way: p"(t) = p(tfc) if t G [tk,tk+i) for /c = 0, . . . , n — 1 and 
tk = kT/n. Then p"(i) converges to p{t) P C^—a.s. Therefore 

' ^ n— 1 

lim Ep -y^H{tr,p''{tr+i)) =Ep / H{s,p{s))ds 



n— >+oo 



r=0 



= Ep 
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To complete the proof of (|2.23p it is enough to show that 



Ep 



n-l 



-5^i/(t„p"(Wl)) 

n 



r=0 



> V^(0,po) 



(2.24) 



where t = 1/n. As for Lemma 12.61 the proof of ()2.24p is achieved by showing by induction 
on A; G {0, . . . ,n} that 



Ep 



-Y,H{tr,p^{tr+l)) 



r=0 



> Ep 



k-i 



V"(tfe, p(tfc)) + T ^ H{tr, p"(Wl)) 



r=0 



(2.25) 



For k = n the resuh is obvious since \"^{T, •) = 0. Assume that the result holds for k + 1. 
We note that, since 

V^tk+i,p) + TH{tk,p) > V^{tk,p) Vp G A(/) 

from the construction of V'^(tfc, •) and since V'^(tfc, •) is convex and p" is a martingale under 
P, we have 

Ep[V-(tfc+i,p"(tfc+i)) + rF(4,p(tfc+i)) I Gk] > Ep[V-(ifc,p"(tfc+i)) I Gk] 
> V-(tfc,Ep[p"(tfe+i) I Gk]) = V-(tfc,p"(tfc)) 



So 

Ep [^E"=0^(ir,p"(Wl)) 

which completes the proof of (|2.25|) . 



> Ep 

> Ep 



V-(tfc+i, p(tfc+i)) + r Eto Hitr, p"(Wi)) 

r=0 



V-(tfc, p(tfe)) + r E'=d HiU, p"(Wi)) 



2.3 Proof of Theorem 12.11 by dynamic programming principle 

The idea is to show that the map 



W{to,Po) = inf Ep 

PGM(to,po) 



H{s, p{s))ds 



to 



V(to,Po) G [0,T] X A(/) (2.26) 



is a solution of equation (jl.lip such that W{T,p) = 0. Since, in view of Proposition II. 51 this 
equation has a unique solution and V is also solution, we get the desired result: TV = V. 

Arguing as in the proof of Lemma 12.21 we first note that there is at least an optimal 
martingale measure in the minimization problem (j2.26p . 



Lemma 2.7 W is convex with respect to po and Lipschitz continuous in all variables. 
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Proof : Let po,pi G ^{I), Po £ M(to,Po) and Pi G M(to,Pi) be optimal martingale 
measures for the game starting from {to,po) and {to,pi): 

rT 



H{s, p{s))ds 



to 



W{to,Pj] 



Pxit) 



for j = 0, 1. For any A G [0, 1], let px = {1 — X)po + Xpi and pA be the process on D(to) 
defined by 

Px, if t < to 
p{t), ift>to. 

We define finally a probability measure Pa G M(to,Po) by : For all measurable function 
$ : D(to) ^ 1R+, 

EpJ^(p)] = (1 - A)Epo[$(pa)] + AEpJc1>(pa)]. 



Then Pa clearly belongs to M.{to,px) and 



Wito,Px)<^F, 



H{t,p{t))ds 



to 



il-X)W{to,Po) + XW{to,Pi) 



This proves that W is convex with respect to pq. 

We now prove that W is Lipschitz continuous. Since W is convex with respect to pq, 
we need only to prove that W is Lipschitz continuous at the extremal points (to,ej), to £ 
[0, T], i G {1, . . . , I}: namely we have to show that there is some K >0 such that 

\W{t'Q,po)-W{to,ei)\ <K{\po-ei\ + \t'o-to\) Vt[„to G [0,r], po G A(I), iG {!,..., I}. 

Let tg, to £ [0, T], Pq £ A(/) and i G {1, . . . , /}. One easily checks that M(to, ej) consists in 
the single probability measure under which (p(s),t < s < T) is constant and equal to e,. 
Consequently 

W{to,ei) = j^ H{s,ei)ds . 

Let P be the optimal probability measure for problem ()2.26p with starting point (tQ,po)- 
We can write 

\W{t'o,Po)-W{to,ei)\ = \Bp Jj^ H{s,p{s))ds - fi^^ H{s,ei)ds\ 

< C\to - t^l + Ep \H{s, p{s)) - H{s, ei)\ds , 

where C is an upper bound of the map {t,p) \H{t,p)\ on [0,T] x A(7). 
Now let AC be a Lipschitz constant for H. Then 

Ep \H{s,p{s)) - H{s,ei)\ds < kEp fj' \p{s) - ei\ds 



< Ej=iEp/Jp,(5)-5.,|(i. 

= Ej^. Ep p,{s)ds + Ep - p,{s))ds 



(r-to)E=i H-^'. 
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where, for the last hne, we used the fact that, under P and for all j £ {!,••• ,1}, Pj is a 
martingale. Finally 



which completes the proof. 



Lemma 2.8 The following dynamic programming holds: for any Q-stopping time 9 taking 
its values in [to, T], 



W{to,Po)= inf Ep 
PeM(to,Po) 



H{s,pis))ds + wie,p{e)) 



to 



(2.27) 



Proof : Let us introduce the subset M'^(to,Po) of M(to,Po) consisting in the martingale 
measures P on D(to) starting from pQ at time to and for which there is a finite set S C A(/) 
such that any p £ Spt(P) satisfies p(t) € S for t G [to,T] P-a.s. It is known that M-^(to,Po) 
is dense in M(to,po) for the weak* convergence of measures. In particular it holds that 



W{to,po) = inf Ep 
PeM/(to,po) 



H{s, p{s))ds 



to 



V(to,Po) G [0,T] X A(/), 



and, since the map P Ep ^ J^^ H{s,p{s))ds + W{9,p{9))^ is continuous for the weak'' 
topology, the lemma is proved as soon we have shown that 



W{to,Po) = inf Ep 
PeM/{to,Po) 



H{s,pis))ds + W{9,p{9)) 



to 



(2.28) 



We shall prove (j2.28p for stopping times taking a finite number of values, then we generalize 
the result to all stopping times by passing to the limit. 
Let be a ^-stopping time of the form 

L L 



(2.29) 



1=1 1=1 

with to < Ti < . . . < TL < T and, for all / G {1, ... , L},Ai G 0^- Let P G M-^ {to,Po) be 
e— optimal for W{to,po) and S = {p^, . . . ,p^} be such that P[p(0) G 5] = 1. We have 



Ep 



H{s, p{s))ds 



Ep 



J] Ep [ r H{s, p{s))ds Ai n {pin) = pi] 

j,l LJr, 



But, since P|^jn|p(^j)=pi j G M(r/,]>'), we have, for all I and j, 



Ep 



rp 

[ His,pis))ds Ain{piri)=pi} 



^Air\{p(Ti)=pi} 

(2.30) 

(2.31) 
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Therefore 



W{to,po) + e> Ep 
> Ep 
= Ep 



fto H{s,p{s))ds 

in{p{T,)=pj} 

flH{sMs))ds + W{9,p{e)) 



(2.32) 



To prove the converse inequality, let Pq G M'^(to,^'o) be e— optimal in the right-hand 
side of (12:28]) and let S = {p^, . . . ,p^} be such that Po[p(6') G 5"] = 1. For any G [to,T] 
and p^ G S, let P;j be e— optimal for W{ti,p^). We define a measure P G M(to,Po) in the 
following way : For any function / : IR ^ A(/) and / G {1, ...,/}, we define a process 



fit), iit<Ti 

p{t), iit>Ti. 



Then we set, for all measurable function <I> : D(to) ^ IR.+ , 



Ep[cl>(p)] =Ep„ 



Then P G M(to,Po) Siiid we have 



W{to,po) < Ep [f;^H{s,p{s))ds 

= Epo 

< Ep„ 

= Epo 



J'l H{s,p{s))ds + "^ij lA,n{p{n)=p^}iWiTi,p^) + e) 
jlH{s,p{s))ds + W{9,p{e)) + e 



(2.33) 



< inf 



PGM/(io,po) 



Ep 



flH{s,p{s))ds + Wie,p{0)) 



+ 2e . 



This allows us to conclude that ()2.28p holds for stopping times taking a finite number of 
values, and it remains now to show that (j2.28p holds for all stopping times. But this last 
part of the proof is standard: we just have to notice that, if 9 stands now for a general 
^-stopping time with 6 G [to,T], we can always find a sequence (^n)n>o of stopping times 
of the form (j2.29p such that 0„ \ as n ^ oo and that, for all P G M(to,Po)! we have 



Ep 



His,pis))ds + Wi9n,pien)) 



Ep 



H{s,p{s))ds + Wi9,p{9)) 



to 



Lemma 2.9 W is a solution of 
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Remark 2.10 The proof of Lemma 12.91 is interesting because it shows that the martingale 
minimization problem gives rise to the penalization term Amin (p, 

Proof : Let us first show that is a supersolution of (jl.lip . Let cj) = (pit^p) be a smooth 
function such that (p < W with an equality at (^OiPo) £ [0)^) ^ ^(^)- We want to prove 
that 



min <{ 0t(to,Po) + H{to,po) ; Amin ( Po, ^(^cPo) ) < 



For this we assume that Amin yPo, §^(*05Po)j > and it remains to show that 

Mto,Po) + H{to,po) < 0. (2.34) 
We claim that there are r,5 > such that 
W{t,p) > (P{t,po) + {^{t,po),p- po) + <5|p - Pop G [to, to + r], Vp G A(/) . (2.35) 

Proof of 12.35\) : From our assumption, there are r/ > and 5 > such that 
{^it,P)z,z) > 46\z\^ \fz G Ta(/)(po), V(t,p) G Br,{to,po) , 
where 7a(/)(pg) is the tangent cone to A(/) at pq: 



T^ii){po)= [Jim -Po)/h 



h>0 

Hence for {t,p) G Brj{to,po) we have 

W{t,p) > ^{t,p) > cp{t,po) + {^{t,Po),p-Po) + 25\p-po\^ . (2.36) 
We also note that, for any p G A(/)\Int(i?^(po)), we have 

Wito,p)>cPito,po) + {^ito,Po),p-po) + 25r]^ (2.37) 
because, if we set pi = Po + \p-pl\ ^ ^ 9pW{tQ,pi), we have 

W{to,p) > W{to,pi) + {pi,p-pi) 

> (t){to,po) + (§^(to,Po),Pi -Po) + 25?/^ + {pi,p-pi) 

> Hto,Po) + {%{to,Po),p-Po) + 26rf + (pi - |^(to,po),p - pi) 

where 

dcj) 

{Pi - -Q^{to,Po),P-Pi) > 
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because w is convex, pi G d^, W{to,Pi), ^{t,Po) G dp W{to,po) andp-pi = j{pi-po) for 
some 7 > 0. Let us now argue by contradiction and assume that our claim (|2.35|) is false. 
Then there are — > to and p„ — > p G A(/) such that 

W{tn,Pn) < 4>{in,Po) + (^(*n,Po),Pn - Po) + S\pn - 



Note that ^ Brj{po) because of ()2.36p . Letting n —>■ +00, we get that p G A(/)\Int(S^(po)) 
and 

W{to,p) < (t>{tQ,p) + {^{to,Po),P - Po) + Sr]"^ . 
This contradicts (j2.37p . So (j2.35p holds true for some r > sufficiently small. 



Fix e > and t G {tQ,T). Because of the dynamic programming (Lemma 12. Sp . there 
exists P* G M(to,Po) such that 

ft 



Er 



H{s,p{s))ds + Wit,pit)) 



to 



<W{to,po) + e{t-to) 



Using the above inequality, (j2.35p and the equality </)(to)Po) = W{tQ,po) we get 



Ex 



H{s,p{s))ds + 4>{t,po) - 0(to,Po) + S\p{t) -po\ 



to 



< e{t - to) 



(2.38) 



(2.39) 



because 



Ept 



{-Q^{t,po),p{t) -po) 







since P* is a martingale measure. We note that (j2.39p implies in particular that there is a 
constant C > such that 

Ept [ \p{t) - pol^ ] < C{t- to) Vt G [to, to + r] 

because H is bounded and (j) is smooth. Since (p(s)) is a martingale under P* this also 
implies that 



Ept [ |p( 



Pol 



< C{t - to) Vs, t with to<s<t<to + r. 



Therefore, since H is k— Lipschitz continuous with respect to p, we have 



Et 



H{s, p{s))ds 



to 



H{s,po)ds 



to 



< K 



ft 1 3 

/ (Ept [ |p(s) - Pol' ])'ds< CK{t-to)^ . 
J to 



Plugging this inequality into (j2.39p gives, for t — to sufficiently small 
/ H{s,po)ds + (j){t,po) - 4'ito,Po) < 2e(t - to) • 

Jto 
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Dividing this last inequality by {t — t^) and letting t — > to gives ()2.34p . 

Next we prove that is a subsolution of (jl.lip . This part relies on more classical 
arguments. Let (j) = 4>{^i'P) be a smooth function such that cp > W with an equality at 
(toiPo) where po G /nt(A(/)). We want to prove that 

Qp2 



min \ (t)t{to,po) + H{to,po) ; Amin ( Po, ^(to,Po) ) > 



We note that Amin yPo, f^(*0)l'o)j ^ because W is convex with respect to p and pq G 
Int{A{I)). So it remains to show that 

Mto,Po) + Hito,Po) > . 

Fix e > and t G {tQ,T). Because of the dynamic programming (Lemma 12. 8|) . for any 
P G M(to,Po) we have: 



Ep 



His,pis))ds + W{t,p{t)) 



> Wito,Po) ■ (2.40) 



'to 

Let us choose F = dp^. Then we get from the definition of (p: 

'to 

Dividing by {t — to) and letting t — > to gives the desired inequality since e is arbitrary. 



/ H{s,po)ds + (f>{t, Po) - (f>{to,po) > 

Jtn 



Proof of Theorem 12.11 : We have shown that W is Lipschitz continuous (Lemma 12. 7p , that 
it is a viscosity solution of equation (jl.lip such that W{T,p) = (Lemma 12. 9p . Since, 
from [3], this equation has a unique Lipschitz continuous viscosity solution and since, from 
Proposition 11.51 V is another Lipschitz continuous viscosity solution of (jl.lip . we get the 
desired result: = V. □ 

As a consequence of Lemma 12.81 and of the above proof, we have: 

Corollary 2.11 Let (to,Po) be an initial position and P be an optimal martingale measure 
in 112.1^) . Let 9 > to be a stopping time. Then 



V(to,po) =Ei 



H{s,p{s))ds + V{e,pi9)) 



to 
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3 Analysis of the optimal martingale measure 



The section is devoted to the study of the optimal martingale measure in the optimization 
problem (|2.12p . For doing so we first investigate the properties of the value function V 
as well as its conjugate V*. Then we define the set 7i C [0, T] x A(/) where — at least 
heuristically — V satisfies the Hamilton-Jacobi equation. We then show that, if P is an 
optimal martingale measure, then the process p remains on 7i and has jumps only on 
the flat parts of the graph of V(t, •). These two conditions turn out to be sufficient to 
characterize the optimal martingale measure under regularity assumptions on the value 
function. 

3.1 Some properties of V* 

We already know that V is a dual solution of the Hamilton-Jacobi equation (|1.9p . In fact 
we have the following sharper result: 

Proposition 3.1 V* is the solution of the Hamilton-Jacobi equation 

fw-H{t,'^) = in(0,r)xIR^ 
[ w{T,p) = max{pi} in IR^ 

Remark 3.2 Compared to equation (jl.lOp . where p appears as a parameter, j5 is a genuine 
variable in the above equation. 

Proof : We first show that V* is a subsolution of (I3.4ip . Indeed, let (/) he a test function 
such that (p > V* with an equality at Since V*(t, •) is convex and (j) is C^, this implies 

that V* is differentiable with respect to p at {t,p) with p = ^^{t,p) = ^{t,p). Since 
s V*(s,p) — (j){s,p) has a maximum at t, the definition of dual solution gives 

^{t,p) - H{t,p) = ^{t,p) - H{t, ^{t,p)) > . 

So V* is a subsolution of (lOTT) . 

Let W be the solution of (|3.4ip . Since V* is a subsolution of this equation, we have 
W > V* from the standard comparison principle [6] . In order to show the reverse inequality 
we are going to check that W* is a dual supersolution of the Hamilton-Jacobi equation (|1.9p . 
Since H is positively homogeneous, independent of p and since W{T, •) is convex, W{t, •) is 
convex with respect to p for any t E [0, T] (see [10]). From the usual representation formula 
for solutions of (|3.4ip (see [9j), we have 

W{t,p) = inf sup max < Pi — / £i{s, (3{u){s),u{s))ds 
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We have 



W*{t,p) = sup sup mill < p.p — + inf / 



If p G ^{I), for any /3 G an optimum of the map 



li{s,P{u){s),u{s))ds 



p — > mm < p.p — Pi + 



inf / ii{s, f3{u){s),u{s))di 
ueuit) Jt 



is given by 



Hence 



Pi= inf / £i{s, (3{u){s),u{s))ds . 

u&A(t) Jt 



I .1 
W*{t,p) = sup y Pi inf / 



ii{s,(3{u){s),u{s))ds , 



which is Lipschitz continuous in p. If p ^ ^(^)) similar argument shows that W*{t,p) = 
+00. So the map Z = W* is Lipschitz continuous in ah variables, convex in p, such that 
Z* = W is a subsolution of the dual equation (j3.4ip . which shows that Z is a supersolution in 
the dual sense of Hamilton- Jacobi equation (jl.9p . Since V is a dual solution, the comparison 
principle for dual solutions given in [5j implies that V < Z, i.e., W = Z* < V*. This shows 
that V* = W is the solution of (IHIiB . ■ 



Proposition 3.3 If dV*{t,p) = {p}, then V* is dijjerentiable at {t,p) and 

dV* 



dt 



-it,p) = H{t,p) . 



Proof : Since {s,p') dV{s,p') is upper semicontinuous, for any e > one can find 77 > 
such that 

dV{s,p') C B,{p) y{s,p') eO:={t-r],t + ri)x Br,{p) . 
Hence V* satisfies 



dY* 



dt 



{s,p')-H{t,p) 



< ke 



for almost all {s,p') S O, where A; is a Lipschitz constant of H. Thus 



V*(s,p')-V*(s',p')- / H{a,p)da 



< k€\s' - s\ V(s,p'), {s',p) £ O . 



Let now (r/i, z/j) — > (r, z) in IR x IR^ as h ^ 0+. If ph G d\*{t + hTh,p + hzh), then ph ^ p 
as /i ^ and 

V*(t + hTh,p + hzh) - V*(t,p) < V*{t,p + hzh) + //+'^"'' H{a,p)da - Y*{t,p) + eh\Th\ 

< h<ph,zh>+ H{a,p)da + eh\Th\ 
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Hence 

Urn sup I (V* {t + hTh, p + hzh) -^^*{t,p)) < {p, z) + H{t,p)T + e\T\ 
In the same way one can prove that 

hmmf ^ {Y*{t + hTh,p + hzh) - V*(t,j5)) ><p,z> +H{t,p)T - e|r| 
Since e is arbitrary, we finally have the equality: 

Urn ]- (V*{t + hTh,p + hzh) - V*{t,p)) =<p,z> +H{t,p)T , 

which shows that V* is differentiable with ^^{t,p) = H{t,p). 



3.2 The non revealing set H 

The aim of this section is the analysis of the set TC defined by: 

n=S,{t,p)e[0,T)xA{I)\ hminf ^(t + /i,pO - V(t,pO ^ 

We also set 

n{t) = {peA{l)\ (t, p) en} yte [0, T) . 

In fact Ti. is roughly speaking the set of points where the Hamilton-Jacobi equation (jl.Op is 
satisfied. Indeed, if V is C^, then it is exactly so: 

n=!^{t,p)e [0, T) X A(/) I ^ + H{t,p) = o| . 

Lemma 3.4 We have for any {t,p) G [0,T) x A(/), 

rt+h 

V{t,p) <Y{t + h,p) + H{T,p)dT V/iG[0,r-t]. (3.42) 

In particular, 

limmf V('' + ".P')-Vy.P')>_„(,^), ,3.43) 



Remark 3.5 We have therefore: 

W=|(t,p)G[0,T)xA(/)| hminf Y^t+^PlzlMl < .H{t 
I h^O+,p'^p h 
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Proof : From the definition of dual solution, for any p G the map t V(t,p) is a 

subsolution of HJ equation p.9|) . Let t < T and p £ A(/) be fixed. The solution w of (|1.9p 
with terminal condition V(t + h,p) at time t + h is given by the relation 

rt+h 



W[S) 



/ H{T,p)dT + V{t + h,p) ys<t + h. 

J s 



Since V(-,p) is a solution of (|1.9|) with the same terminal condition, we get 

rt+h 

Y{s,p) <w{s) = J H{T,p)dT + Y{t + h,p) \fs<t + h. 

Applying the above formula to s = t we get ()3.42p . We then get ()3.43p thanks to the 
continuity oi H. ■ 

Lemma 3.6 Theset7iisaBorelsubsetof[0,T]xA{I) and 7i{t) is closed for any t [0) hi- 
proof: Indeed, W = P|„ Tink where 

W„,= j(t,p)G[0,T]xA(/)| inf Yil±lhPlzlMl<.H(t,p) + l 

{ he{0,l/n],\p'-p\<l/n n k 

which are Borel subsets of [0,T] x A(/) since V and H are continuous. Moreover TC^t) is 
clearly closed for any t G [0, T] because H is continuous. □ 

In the proof of Lemma 12.71 we have already noticed that 

V{t,ei) = H{s,ei)ds , 

where {ei, . . . ,e/} is the standard basis of IR^. This implies that S for any i = 

1, . . . , /. In particular, 'H(t) is nonempty for any t G [0, T]. More precisely we have: 

Lemma 3.7 Let {t,p) £ [0, T) x A(/) and p £ d'V{t,p). //V*(t,-) is differentiable at p, 
then {t,p) belongs to 7i. 

Proof: From Proposition 13.31 V* is differentiable at {t,p) because V*(i, •) is differentiable 
at p. Let h > he small and ph G dY*{t + h,p). Then 

Y{t + h,ph)-V{t,Ph) ^ Y*{t + h,p)-Y*{t,p) 
h - h 

because V(t + h,ph) = p^.p — V*(t + h,p) and V*(t,p) > p^.p — Y{t,ph)- Hence 
r Vit + h,ph)-V{t,Ph) ^ 

hmsup < — 7T-[t,p) < -H{t,p) 
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since V* is differentiable at {t,p) and from the definition of dual solution. We complete the 
proof thanks to Lemma 13.41 ■ 



The next Lemma explains that, for any {t,p) € [0, T] x IR^, the convex hull of 9V*(t,j5)n 
H^t) is exactly equal to d'V*{t,p): 

Lemma 3.8 For any {t,p) G [0,T] x A(/) and any p G dY{t,p), there are (X^) G A(/), 
p^ G n{t) n dV*{t,p) for j = !,...,! such that 

I I 

AV =P and AJ V(t,p?) = V(t,p) . 

Proof : Let p G c?V(t,p) and, for e > small, p^ = p + e^. Since V* is Lipschitz continuous, 
there are pn — > Pe at which V*(t, •) is differentiable. If we set pn = ^^{tn,Pn), then Lemma 
13.71 states that the points pn belong to 7i{t). Letting n +oo, we can find a subsequence 
of the (pn) which converges to some G (?V*(t,pe) H Ti.{t). 

We now let e — > to find some p^ G dY*{t,p) n 7i{t). Moreover we have p^.(, > p.^ 
because 

{Pii-V,Cl= lim(Pe-p,0= lim -(p, -p,p + e^-p) > 
thanks to the monotony of the subdifferential. In particular, 

V-i < Pi-i < sup p'.^ G IR^ , 

which proves that p belongs to the convex envelope of dY*{t,p) n 7i{t). The Lemma now 
follows easily from the fact that V(t, •) is affine on dV*{t,p). ■ 



3.3 Analysis of the optimal martingale measures 

We are now ready to study the optimal martingale measures in the optimization problem 
(j2.12p . The main result of this section is the following: 

Theorem 3.9 Let P be an optimal martingale measure in i2.12\) . Then 

(s,p(s))gW Vs G [to,T], P a.s. (3.44) 
and, for any s G {tQ,T], there is some measurable selection ^ o/ 9V(s, p(s^)) such that 

V(s,p(s))-V(s,p(5-))-(^,p(s)-p(s-)) = Pa.s. . (3.45) 
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Remark 3.10 The two conditions turn out to be necessary under suitable regularity con- 
ditions on the value function V and the martingale measure P. See Theorem 13.111 below. 

Proof : For any e,6 > 0, let us set 

Ks = {{t,p)e[0,T-6]\V{t + h,p')-V{t,p')>h{-H{t,p) + e) V(/i, p') G [0, 5] x (p) } 



Then TC^ g is closed and 



U nis = mT]xAii))\n. 

E,5>0 



Hence we have to prove that (t, p{t)) ^ TC^ g for any t £ [to, T] P— a.s. Let us note for later 
use that 

rt+h 

V{t + h,p) -Y{t,p)> - J H{s,p)ds + -h yhe[0,6], y{t,p) enls , (3.46) 
provided 5 > is small enough. Let us introduce the stopping time 

9 = mf{s>t\is,pis))enis} 

(with the convention that ^ = T if (s, p(s)) ^ for any s > t). Let A = {6 < T}. Let us 
assume that P(^) > 0. From (j3.46p we have on A: 

r-e+h 

Y{9,p{e)) <V{9 + h,p{9))+ His,pi9))ds- -h V/iG[0,<5]. 

Je ^ 

Hence, for any h G [0, 5], 



Ep [V(0,p(0))]<Ef 



{e+h)AT 

V{{9 + h) AT,p{e))+ I H{s,p{9))ds 



-hPlA] . 



^From the dynamic programming principle Corollary 12.111 and the fact that P is optimal 
we also have 



Ep [V(0,p(e))]=Ei 



So, for any h £ (0, 5], we have 



\{{9 + h) AT,p{9))+ / H{s,p{s))ds 

Je 



1. 



-E. 



(e-\-h)AT 



{H{s,pi9))-H{s,p{s))ds 



which is impossible since p is right-continuous and P[A] > 0. So we have proved that 9 
P— a.s., which means that {t,p{t)) ^ Ti-^ g for any t G [toi^] P— a.s. 
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We now check that (|3.45p holds. Let s > t^, h > and be a Qs-h measurable selection 
of 9V(s — h, p(s — h)). Then we have from the dynamic programming (Corollary 12. 



V(s,p(s))-V(s-/i,p(s-/i)) 



H{T,p{T))dT 



s — h 



. 



(3.47) 



Hence 

Ep [V{s, p{s)) - Y{s - h, p{s - h)) - iCh, p{s) - p{s - h))] 
< Ep [(a,p(s) - p{s - h))] + h\\H\\^ = h\\H\\^ 
since p is a martingale. Since (^/i) is bounded in L°°, we can find a subsequence, again 
denoted (^/i), which weakly converges to some ^ in as /i ^ 0. Note that ^ G av(s, p(s")) 
because £ i9V(s — h, p(s — h)) and p is has a left limit. So we can let /i ^ in (j3.47p to 
get 

Ep[V(s,p(s))-V(s,p(s-))-(C,p(s)-p(s-))] < 0, 
where V(s, p(s)) - V(s, p(s")) - (C, p(s) - p(s")) > a.s. So holds. □ 



3.4 A verification Theorem 

If the value function V is sufficiently smooth, then the conditions given in Theorem 13.91 are 
"almost sufficient" in order to ensure a martingale measure to be optimal. 

Theorem 3.11 Let (toiPo) £ [0, T] x A(/). Let us assume that V is of class C^'"^ and that 
P belongs to M(to,Po) one? is such that 

(i) p{t) G n{t) for almost all t G [to,T] P-a.s., 
(a) P—a.s., 

Y{t, Pit)) - V{t, p(r )) - {^{t, p(t-)), p(t) - Pit-)) = Vt G [to, T] , 

(Hi) P is a purely discontinuous martingale measure. 
Then P is optimal in problem 112.1!^) . 

Remark : The additional assumption that P is purely discontinuous can be justified 
in some particular cases. See Proposition 14.21 below. 

Proof: Since V is of class C^'^, the set Ti is given by 

W=|(t,p)G[0,r]xA(/)|^(t,p) 
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= -Hit,p) 



We now use Ito's formula and the fact that P is purely discontinuous to get 
= Ep[V(r,p(r))] = V(to,Po) + Ep [f^l ^{s,pis))ds 

+ E.>*„ v(.,p(.)) - v(.,p(.-)) - (|^(.,p(.-)),p(s) 



p(^-)) 



V(to,Po) -Ef 



H{s, p{s))ds 



to 



The proof of Theorem 13.111 is now complete thanks to Theorem 12.11 



□ 



4 Examples 

4.1 The autonomous case 

If the payoffs £i = £i{u,v) are independent of time, it is proved in [l3| that 

V(t,p) = (T - t)YexH{p) V(t,p) G [0,r] x A(/) . (4.48) 

Note that this equality is exactly what Aumann-Maschler formula states for repeated games 
with incomplete information on one side (see [1]). In view of (|4.48p we have 

n = [0, T]x{p€ A(/) I YexH{p) = H{p)} . 

Let us now fix (to,p) G [0,r] x A(I). Let (A^) G A(/) and any p^ G A(/) (A; = 1, . . . , /}) 
such that 

Xkp'' =p and ^kH{pk) = VexF(p) . 

fc=l k=l 

We consider the probability measure P G M(to,p) under which, for all G {1, . . . , /}, with 
probability Afc, p is contant and equal to pk on [t^^T) . 

Proposition 4.1 The measure measure P is optimal for the minimization problem i2.12\) . 
Proof: Indeed 



Ep 



/ H{p{s))ds =iT-t)Y,^kH{p'') = {T-t)\exH{p)=Y{t,p) . 

J 7 — 1 



k=l 

□ 
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4.2 Examples when 1 = 2 

In this section we assume that 1 = 2. We first show that, under suitable regularity properties 
of V and TC, there is a purely discontinuous martingale which remains in Ti. and jumps only 
on the flat parts of the graph of V. Then we give an example where one can explicitly 
compute the set 7i and the optimal martingale measures. 

In this section we denote by p G [0,1] instead of (p, 1 — p) (for p £ [0,1]) a generic 
element of A(/). The function V = V(t,p) will be defined on [0, T] x [0, 1]. 

Proposition 4.2 Let us assume that V is of class and that the set-valued map t — > 'H(t) 
enjoys the following regularity property: there is some non decreasing map K : [0, T] — > 
[0, +oo) such that 

Vs, t £ [0, T) with s<t,yp£ n{s), 3p' G n{t) with \p' - p\ < K{t) - K{s) . (4.49) 

Then, for any initial position {tQ,po) there is martingale measure P G M(to,Po) under 
which the process p satisfies conditions (i), (ii) and (Hi) of Theorem \3.11[ 

An example of value function satisfying condition (j4.49p is given in Example 14.41 below. 

Remark 4.3 It is not known if there always exists an optimal martingale measure which 
is purely discontinuous without an additional assumption like (j4.49p . In fact in the case 
/ = 2 we have no example of a martingale measure which satisfies (i) and (ii) of Theorem 
13.111 but not (iii). For / > 3, we give an example below. 

Proof : Without loss of generality we assume that to = 0. From Lemma 13.81 for any s < t, 
and any p G 'H(s), there are pi,P2 G 'H(t) such that p G {pi,P2) and V(t, •) is affine on 
[pi,P2]- If we choose pi as large as possible and p2 as small as possible (recall that we can 
do this since Ti-^t) is closed), then we have from our assumption (j4.49p that 

min{|p-pi|; \p - p2\} < K{t) - K{s) . 

Let A G [0, 1] be such that Xpi + (1 — X)p2 = P- Note for later use that 

A|pi -P\ + {1- X)\P2 -P\< 2{K{t) - K{s)) (4.50) 

and that the maps pi = pi(t,p), p2 = P2{t-,p) and A = \{t,p) Borel measurable. 

Let us now introduce a large integer n and a time step r = T/n > 0. We set tk = rk for 
i = 0, . . . ,n. As in section [2^2] we define by induction the process (p^)fc=_i^,,,^„ such that 
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(i) p":i =po, 

(ii) forany fc>0, G W(tfc), 

(iii) knowing p^, p''J^_^_l is equal to piitk,Pi) with probability A(tfc,p") and P2itkiPi) with 
probability (1 - A(tfc, p^")). 

We first note that p" is a martingale. From (j4.50p we have 

E [|p^+i - P^l I P^] < 2iK{t,)) - K{tk+i)) . 
Therefore the process p" has bounded total variations: 



E 



n-l 



IPfe+l ~ Pk\ 



.k=0 



< 2{K{T) - K{0)) . (4.51) 



We now interpolate the process p" as in section 12.21 in order to get a martingale measure 
P" G M(0,po)- Following [TT], letting n +oo, we can find a subsequence, again denoted 
p", such that the law of the process p" converges to some P G M(0,po) and such that 
p"'(t) converges in law to p(t) for any t belonging to some subset of full measure T of [0, T]. 
Because of (j4.5ip . p has finite total variations under P and therefore is purely discontinuous. 
We now check that p satisfies conditions (i) and (ii). Let 7i be the set of t G T at which 
the map K is continuous. Then Ti is of full measure in [0, T]. For any t G 71 let kn be such 
that knT — > t and t G [A;„r, {kn + 1)t). From assumption (j4.49p . 

d{p,n{t)) < K{t) - K{tkJ Vp G Spt(p"(t)) , 

(where d{p,7i{t)) is the distance of p to the set W(t)) because p"'(t) = p^^ and p^^ G 'H(tfc) 
P— a.s.. Letting n — > +00 implies that Spt(p(t)) C Ti-^t) P— a.s. since p"'(t) converges in 
law to p(t) and K is continuous at t. 

For proving that p satisfies (ii), let us first note that 

V(tfc+i, p^+J - V(tfc+i, p^) - {^{tk+i,pl), p^i - P^) = VA: G {0, . . . , n - 1} . 

Hence 

E [V(tfc+i,p^+i)] = E [\{tk+i,pl)] Vfe G {0, . . . ,n - 1} (4.52) 

because (p^)fc is a martingale. Let s,t G T be such that s < t and ki,k2 be such that 
s G [tki,tki+i), t G [tk2,tk2+i)- Then 

V(t, p"(t)) - V(s, p"(s)) < V(tfc, , p[' ) - Y{tk, , pL, ) + 2C{t -tk,+s- tu, ) 
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where C = ||^||oo and where 



Combining (|4.52p with the above inequahty gives 



E [V(t, p"(t)) - Vis, p^is))] <Cit-s + T). 

Letting n — > +00 leads to 

Bp[Vit,pit))-Yis,p{s))]<Cit-s) 

^From the right-continuity of the process pit), this inequahty also holds for any t. Since p 
is a martingale we get 



v(t,p(t)) - v(.,p(.) - {^{t,p{s))Mt) - pm 



< C{t - s) 



for any t S (0, T], s G T, s < t. Letting now s ^ t with s € T gives 



Ef 



V(t,p(t)) - V(t,p(t-)) - (^(t,p(t-)),p(t) -p(t-))) 



< Vt G (0, T] 



Since V(t, •) is convex this last inequality finally implies that 

Y{t, Pit)) - V(t, Pit-)) - i^it, Pis)), Pit) - Pis)) = 
for any t G (0, T] P a.s. 



□ 



Our aim is to identify TC under the following assumption on H: 

Example 4.4 We assume that there exist /ii,/i2 : [0,T] [0,1] continuous, hi < /i2, hi 
decreasing and /12 increasing, such that 



VexHit,p) = Hit,p) ^ p£[0, hiit)] U [/i2(t), 1] 



(4.53) 



and 



it,p) >0 V(t,p) withpG [0,/ii(t))U(/i2(t),l] . 



(4.54) 
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For instance, if we assume that U = [—1,1], V = [0, 2tt] and 

ii{t, u,v) = u + a{t) cos{v), £2{t, u, v) = —u + a{t) sin(?;) V(u, w ) € [/ x 1/ 

where the smooth map a : [0, T] ^ ]R is decreasing and such that a{t) > 2 for any t G [0, T], 
then 



H{t,p) = -\2p-l\+ a(t) vV + (1^pF 
satisfies (|i33D and (irai) with hi{t) = 1/2- l/(2a2(t) -4)i, /i2(t) = 1/2 + l/(2a2(t) -4)i 

Proposition 4.5 Under the assumptions of Example \4-4[ 

V{t,p) = YexH{s,p)ds '^{t,p) e [0,r] X A(/) 

and 

n = {{t,p) G [0,T] X [0,1] |pG [0,hi{t)]U[h2{t),l]} . (4.55) 
In particular, V is of class C^'^. 

Remark 4.6 The above representation for V does not hold true in general. For instance 
let H{t,p) = A(t)p(l — p) where A : [0, T] ^ IR is Lipschitz continuous. We set A(t) = 
X{s)ds. If 

A > on [0,6), A < on {b,T], A(a) = 
for some < a < b < T, then one easily checks that 



if t G [0, a] , 

A{t)p{l-p) ift€[b,T]. 



V{t,p) -- 
In particular 

V{t,p) / yexH{s,p)ds = A{b)p{l-p) V(t,p) e (a, 6) x (0,1) . 

Note also that in this example the dynamics is smooth, the value function V is smooth with 
respect to the variable p, but V just Lipschitz continuous with respect to the time variable. 

Proof of Proposition 1131 Let w : [0, T] x [0, 1] ^ IR be defined by 

w{t,p) = j^ \exH{s,p)ds V(i,p) G [0,r] X A(/) . 

32 



We note that w{T,p) = 0, w{t, 0) = V(t, 0) and w^t, 1) = V(t, 1). One easily checks that w 
is a solution of the HJ equation 



' mm{wt+H{t,p),^]=0 
w{T,p) = 



Indeed, if p G /i2(t)), then 



w 



{t,p) = and wt{t,p) = H{t, h{t)) < H{t,p) 



Upe (0,/ii(t)] U [/i2(t),l), then 

dp^ 



{t,p) >Oand wt{t,p) = H{t,p) 



(where the first equality holds in the viscosity sense since w is convex with respect to p). 
Therefore = V and Ti. is the set of points {t,p) at which H = YexH, i.e., given by (j4.55p . 



Proposition 4.7 Under the assumptions of Example \4-4\ there is a unique optimal mar- 
tingale measure P. Under this martingale measure, the process p is purely discontinuous 
and satisfies: 

p{t-)=pQ \/t e [to,t*]P - a.s., where t* = inf {t > to \ po e [hi{t), h2{t)]} 

and 

p{t) £ {hi{t),h2it)} yt £ [t*,T)P-a.s. 

In particular, 

P [p{t) = h,{t) I p(.) = h,{s)] = yt*<s<t<T. (4.56) 

Remark 4.8 Set T = i, hi{t) = ^ - h2{t) = ^ + Vi, t £ [0,T], to = and po = ^. 
Since there is only one martingale measure that charges the graphs of hi and /i2, the process 
p under P is, up to a constant, the Azema martingale with parameter 2 (see Emery ^): 
under P, {X{t) := p{t) — ^, t £ [0,T]) satisfies the structure equation 

d[X]t = dt- 2X{t-)dX{t), t £ [0, r], X(0) = 0. 
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Proof of Proposition 14. 7t We do the proof in the case t* < T and pq ^ [/ii(io)) ^2(^0)]) the 
proof of the other cases being similar. Under these assumptions, t* > to- Let us fix P some 
optimal martingale measure. We need below the following result: 

Claim : Let 6* > to be a stopping time and let us assume that p(^~) ^ [hi{9), h2{0)] on 
some set A ^ !Fq with positive probability. Let 9' be the stopping time 

9' = ini{t>e\p{t)e[hi{t),h2{t)] } 

(by convention, 9' = T if there is no such a t). Then, on A, P— a.s., 9' > 9 and p{t) = p{9~) 
forte I9,9'l. 

Proof of the claim : Since p(^~) ^ [hi{9),h2{9)] on A, V(0,-) is strictly convex in a 
neighborhood of p(^^). Applying the equality obtained in Theorem [ 



(4.57) 



V(t, p(t)) - V(t, p(t-)) - (^(t, p(t-)), p(t) - p(t-)) = 



at t = 0, we get that p{9) = p{9^) P— a.s. on A. Since p is right-continuous, 9' > 9 
on A. Using (|4.57p again on shows that p is continuous on that p{9'^) G 

{hi{9'), h2{9')} (since p is not allowed to jump until it reaches the graphs of hi and /12) and 
that, on A, we have 9' = lim^\o9[, with, for 9'^ = inf{t > 6',p(t) G [/ii(t) - e, /i2(t) + e]}, 
with = T if there is no such t. 
Let us now apply Ito's formula between 9 and 9': 



Ep [V{9',p{0'))]='Ei 



re' ^ re' 

Y{9,p{9)) + J^ Yt{s,p{s))ds + -J^ __(s,p(s-))d<p^>. 



(4.58) 

where p'^ is the continuous part of p under P. Since p(s) € 'H{s) for almost all s P— a.s., 



Ef 



■ re' 

/ \t{s,p{s))ds 
Je 



Ef 



H{s, p{s))ds 



^From our assumption on V, we also have 



because 



Qp2 

t'{p) ^ 

dp^ 



(s,p(s-))>0 Vs e [0,0'[P-a.s., 



(4.59) 



(4.60) 



{T,p)dT (where t*{p) = inf{s > | {s,p) ^ H}), 



which is positive as soon as t*{p) > s. Since, from Corollary 12. 11^ we have 



Ep [V(0',p(0'))] =Ef 



V{9M0)) 



H{s, p{s))ds 
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combining the above equality with (j4.58p . (j4.59p . (|4.60p gives that d < p'^ >s= P—a.s. on 
[6*, O'J. This imphes that, for all e > 0, the restriction on A of the martingale (P(tve)A6»^)iG[o,T] 
is simultaniously continuous and purely discontinuous on [0,T], thus it is constant. There- 
fore p restricted to A is constant, equal to p{0^) on {6, O'l, and the claim is proved. 

Let us now prove that p{t) = po on [tQ,t*). For this we introduce the stopping time 

e = M{t>to I p{t) e [hi{t),h2{t)] } . 

Since p(to ) = po ^ [hi{tQ), /i2(io)]) applying the claim to the stopping time to we have that 
61 > to and p(t) = po for t £ {to, 01 P-a.s. Since p{t) = po ^ [hi{t),h2{t)] for t E {to, 61, we 
have 9 < t* . Since p{9) G 'H{9), we also have 9 > t*. Therefore 9 = t* and p(t) = po on 

[to,t*). 

We now prove that p{t) G {hi{t), h2{t)} for t £ [t*,T) P—a.s. Let us introduce, for any 
e > 0, the stopping time 

9, = mf{t>t*\p{t) e [0,/ii(t)-e]U[/i2(t)+e,l]}, 

(we set 9^ = T ii there is no such at). 

Suppose now that there exists some e > such that P[9e < T] > 0. Without loss of 
generality we can suppose that the set A := {/i2(0e) + e < p(^e) < 1} H {9^ < T} satisfies 
P[A] > 0. By definition of 9^, and since /i2 is increasing, we have 

p(t) < p{9,) on r,^4n([0,r] X A). (4.61) 

iFroui ()4.57p again applied on A at time 9^ we get, P-a.s., p{9^) = p{9e) and therefore 
9^ < 9^, for all < e < e. But, still by (j4.57p and the claim, on A, p is constant on the time 
interval {9^, (0f)'[. Choosing now e close enough to e to get < P[A n {/i2(6'e) < p{9e)}] < 
P[A n {9e < (6*?)'}], we obtain a contradiction to (|4.6ip . 

Equality ()4.56p is then a straightforward application of the fact that p is a martingale 
which lives the union of the graphs of hi and /i2- Finally, p is purely discontinuous since it 
has finite total variations. □ 

4.3 Examples in higher dimensions 

Example 14.41 can be extended to higher space dimensions. The interesting feature for / > 3 
is that there are several optimal martingale measures in general. They can be purely 
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discontinuous, as in the two-dimensional case, but they can also be continuous. 

Example 4.9 We assume that there exists a smoothly evolving and increasing familly of 
smooth open convex subsets {K(t))fi=^Q^'j-] of A{I), whose closure in contained in the interior 
of A{I), such that, for any t £ [0, T], 

YexH{t,p) = H{t,p) ^ p^ Kit) , •) is affine on K{t) 

and 

a2 



{t,p) is definite positive for p ^ K(t). 



dp"^ 

Following the proof of Proposition 14.51 we get: 
Proposition 4.10 Under the assumptions of Example \4-9l 

Y{t,p) = j^ \exH{s,p)ds V(t,p) G [0,r] X A(/) 

and 

n = {{t,p)e[0,T]x A{I)\p^K{t)} . 
In particular, V is of class C^'^ . 

Next we investigate the optimal martingale measures. 

Proposition 4.11 Under the assumptions of Example \4-9[ any optimal martingale measure 
P has the following structure: 

p{t')=PQ yt£[to,t*] and p{t) £ dK{t) yt > t* , P - a.s., 

where t* = sup{t > to I Po ^ -^(01 • Moreover, there is an optimal martingale measure 
under which p is purely discontinuous. If, in addition, the family (i^(t))^g[o,r] has a positive 
minimal curvature and ifpo ^ K{to), then there is also an optimal martingale measure under 
which p is continuous. 

Remark 4.12 An interesting case is when the evolving set t dK{T — t) is moving 
according to its mean curvature (in A(/)). Indeed, in this case, there is an explicit formula 
for the martingale. If po £ dK{tQ), then there is a optimal martingale measure under which 
the process satisfies 

dp{t) = V2{I- u{t, p{t)) i^{t, p{t))) dWt 

where / is the identity matrix of size (/ — I), {Wt) is an (/ — 1)— dimensional Browian motion 
living in the hyperplane spanned by A(/) and u[t,p) denotes the unit outward normal to 
K{t) atpe dK{t) (see [2] , [E]). 
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Proof : The proof of the structure condition on the optimal martigale measures follows the 
same lines as the proof of Proposition 14.71 and the existence of the purely discontinuous 
martingale measure can be established as in Proposition 14.21 because the set Ti. satisfies 

(sasD. 

Let us now check that there is a continuous optimal martingale measure. As usual we 
start our construction by building a discrete time process p". Let us fix n large, t = T/n the 
time-step and = kr for k = 0, . . . ,n. For simplicity of notations we only build a process 
for an initial position such that to = and po G dK{0). Let Z be the set of z = (zj) G IR^ 
such that J2 - Zi = 0. Note that Z = T^(i){p) for any p £ /nt(A(/)). Let f : Z ^ Z he a 
Borel measurable process such that \ f{z)\ = 1 and {f{z), z) = for any z £ Z. We denote 
by TT{t,p) a Borel measurable selection of the projection of p onto the boundary of K{t). 

We now start the construction of p". We set p'^^ = po. If p^ G dK{tk) is build, then 
we set 

Qi=Pk + Ai/(vr(tfc, p^) - p^) and q2 = pi - A2/(vr(tfc, Pfc) - pI) 

where Ai > and A2 > are such that qi,q2 G dK{tk+i)- Then we set p^j^i to be equal to 
qi with probability A2/(Ai + A2) and (72 with probability Ai/(Ai + A2). The process p" is 
then a martingale such that p^ G dK{tk) for any /c = 0, . . . n. 

We now show that, for any q > 2, there is some constant Ca such that 



^[\pl,-vlX]<C^\tk,-tu, 



\a/2 



(4.62) 



Indeed from the Burkholder-Davis-Gundy inequality we have 
E[|p^,-P^j°] <c„E 



< P >k2 - < P >fcij 




Let us now estimate |p^^^ ~ P^P- Fi'om the condition of positive minimal curvature, there 
is a constant i? > such that 

K{t) c Br{p- Ru{t,p)) n A(/) Vp G dK{t), G [o,r] , 



where v{t,p) is the outward unit normal to K{t) at p. Then, since p1_^i G dK{tk+i), we 
have 

|p^+i - {7r{t,pl) - R,.{tk+un{t,pm\ < R , 
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where 



i/(tfe+i,7r(p^)) 



Kp^)-p^I 

Since by definition of /, /(7r(t, p^) - p^) -L 7r(t, p^) — p^, we liave 

\vl+i-vl? + {R-\<Pl)-Pl\?<R\ 

wliich implies that 

|p^+i-p^P<2i?L(tfc+i-t,) 
where L is a Lipschitz constant of the map t K{t) in the Hausdorff distance. Therefore 

a/2' 



E 



ipfc+i ~ Pfei 

i k=ki 



< {2RLr'\tk,-tu, 



.a/2 



This proves K&2\\ . 

We now set p"(t) = p^ for t G [tfc, tfc+i) and let P" be the law of p" on D(0). From Kol- 
mogorov criterium we can extract a subsequence of (P") which converges to some continuous 
martingale measure P. Since p"(tfc) G dK{tk) for any A; = 0, . . . , n, we have p{t) € dK{t) 
for any t G [0, T]. Using Ito's formula and the fact that 

we have 



Vt(s,p) = -H{s,p) and ^(s,p) = Vp G dK{t), Vt G [0,r] 



o = Ep [v(r,p(r))]=Ep 

Therefore 



V(0,po)+ /" Yt{sMs))ds 
Jo 



V(0,po)-Ei 



i?(s, p(s))(is 



V(0,po) = Ep 
which shows that P is optimal. 



H{s, p{s))ds 



5 Conclusion 

In this paper we have investigated a continuous-time game with finite horizon and imperfect 
information on one side. We have proved that the optimal behaviour of the informed 
player is directly related to the optimal revelation of his/her knowledge. This leads to an 
optimization problem in which the unknown is a martingale measure. We have analysed 
this problem and found some necessary and some sufficient optimality conditions for the 
optimal martingale measure. 

Our analysis raises several intriguing questions: 
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• We have seen that, under suitable regularity conditions, and, in particular, when 
1 = 2, there are optimal martingale measures which are purely discontinuous. Does 
there always exist an optimal martingale measure which is purely discontinuous ? 

• In our 2-dimensional examples, the optimal martingale measure is unique. Is this 
always the case when 1 = 27 

• In the case of a continuous time game in which both players have some private in- 
formation, existence and characterization of the value are established in [5]. The 
equivalent of the martingale characterization (Theorem 12. ip in this framework is an 
open question. 
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